System and method communicating biofeedback to a user through a wearable device

ABSTRACT

A system and method for communicating biofeedback to a user through a wearable device that includes collecting physiological data of at least one physiological property of a user; processing the physiological data into at least one biosignal; monitoring the at least one biosignal for a feedback activation condition; and upon satisfying a feedback activation condition, delivering haptic feedback.

CROSS-REFERENCE TO RELATED APPLICATIONS

This Application claims the benefit of U.S. Provisional Application No.62/113,491, filed on 8 Feb. 2015, which is incorporated in itsentireties by this reference.

TECHNICAL FIELD

This invention relates generally to the field of biofeedback devices,and more specifically to a new and useful system and method forcommunicating biofeedback to a user through a wearable device.

BACKGROUND

Higher levels of heart rate variability have been shown to have arelationship to lower stress levels. Traditional approaches inbiofeedback have used obtrusive techniques to train higher amounts ofheart rate variability. In some cases, these techniques are limited tolaboratory or controlled environments as a result of how feedback wasdelivered. Such problems exist in other fields of biofeedback as well.Thus, there is a need in the biofeedback field to create a new anduseful system and method for communicating biofeedback to a user througha wearable device. This invention provides such a new and useful systemand method.

BRIEF DESCRIPTION OF THE FIGURES

FIGS. 1 and 2 are a schematic representations of a system of a preferredembodiment;

FIG. 3 is a schematic representation of a system worn around the torso;

FIG. 4 is a schematic representation of a system integrated into anundergarment;

FIG. 5 is a schematic representation of a system worn around the wrist;

FIG. 6 is a schematic representation of a system with a multiplewearable devices used in combination;

FIG. 7 is a schematic representation of a system with an one dimensionalarray of haptic feedback nodes;

FIG. 8 is a schematic representation of a system with a removable mainhousing body;

FIG. 9 is a schematic representation of one variation of a 2D array ofhaptic feedback nodes;

FIG. 10 is a detailed schematic of haptic feedback nodes centralized ina rectangular grid;

FIG. 11 is a detailed schematic of haptic feedback nodes centralized ina radial grid;

FIGS. 12A and 12B are schematic representations of converting monitoredphysiological data into a biosignal used for delivering feedback;

FIGS. 13 and 14 are schematic representations of two variations ofsequences of haptic feedback node activation;

FIG. 15 is a schematic representation of a sequence of haptic feedbacknode activation synchronized to a biosignal;

FIG. 16 is a schematic representation of various haptic feedback shapeprofiles;

FIGS. 17 and 18 are schematic representations of haptic feedback nodeactivation mapped to an emotional coordinate system;

FIG. 19 is a flowchart representation of a method of a preferredembodiment; and

FIG. 20 is a flowchart representation of a variation of a method of apreferred embodiment.

DESCRIPTION OF THE EMBODIMENTS

The following description of the embodiments of the invention is notintended to limit the invention to these embodiments but rather toenable a person skilled in the art to make and use this invention.

1. System for Communicating Biofeedback to a User

As shown in FIGS. 1 and 2, a system 100 for communicating biofeedback toa user through a wearable device of a preferred embodiment can includean attachment structure 110, at least one biosensor 120, a hapticfeedback system 130, and a computing system 140. The system 100functions to monitor real-time biosensor data and synthesize thebiosensor data into active feedback. The biosensor 120 collectsphysiological data on at least one biosignal, the computing system 140detects changes in a biosignals that match a pattern or satisfy one of aset of conditions, and the haptic feedback system 130 provides patternsof stimulation to the user. The patterns of stimulation are correlatedwith the biosignal. The haptic feedback is preferably unobtrusive so asto not interfere with routine activities. As one potential benefit, theuser can build an awareness and in some cases control over currentinternal states using the system 100.

The patterns of biofeedback can be mapped to a variety of differentproperties or characteristics of one or more biosignals. In onevariation, the haptic feedback system 130 is an array of haptic feedbacknodes 132, which can enable complex patterns of biofeedback to bedelivered. While, the biosignals are typically beneath the awareness ofa user, the haptic stimulation is active and detectable. Over time, auser may learn to manipulate these vibrational patterns and in somecases gain a degree of conscious control over physiological properties.The haptic feedback can also be used to alert users to a significantchange in their body, communicate internal state to other users, buildawareness of emotions, or used for any suitable applications.

In a preferred implementation, the system 100 is used to deliver hapticfeedback according to the heart rate variability (HRV) of a user. HRVrefers to the variability in heart rate over a given time period. Heartrate varies from beat to beat and high HRV is a general indicator ofheart health. HRV is an integral part of an individual's response tovariations in physiological and psychological demands and inputs fromboth internal and external sources. It represents a person's ability toadapt to shifting internal and external states. HRV is influenced bysympathetic and parasympathetic activity within an individual's body.Thus, HRV additionally represents a person's current state of stress orrelaxation, with low HRV being related to higher stress states and highHRV being related to lower stress states. In one implementation, thebiosensor 120 collects heart beat activity data, which can be used togenerate a heart rate signal. The heart rate signal is a time-orderedsequence of data points on real-time calculations of heart rate—theheart rate signal shows the variation of heart rate as a function oftime. Haptic feedback is delivered when heart rate variability goesbelow a particular threshold, which can be an indicator of beingstressed, anxious, or nervous. The haptic feedback can be a physicalreminder of their internal state, which can lead to mindfulness and asmentioned above changes in physiological state.

As shown in FIG. 3, one exemplary implementation of the system 100 canbe a band worn around the torso of the user. The system 100 can also beintegrated into a bra as shown in FIG. 4, shirt, or any suitable pieceof apparel. In other variations, the system 100 could be a device to beworn on the wrist as shown in FIG. 5, arm, ankle, ear, around the neck,around or on top of the head, or at an suitable location on the body.

As shown in FIG. 6, another implementation can enable a multi-deviceapproach. Sensing could be performed at one or more sites on the bodythrough at least one device and haptic feedback can be performed at oneor more sites by at least a second device. For example, the band may beused for measuring heart activity and a wristband may be used indelivering haptic feedback.

Additionally, the biosensor 120 and/or the haptic feedback system 130could be an accessory component of a computing device such as a smartwatch, smart glasses, or any suitable computing element. Applicationlogic can control such device accessory components in facilitatingimplementation of the system 100.

The attachment structure 110 of a preferred embodiment functions tohouse a set of system components and to physically couple a device to auser when worn. The attachment structure houses at least a subset ofcomponents of the system 100. As mentioned above, the system 100 mayinclude multiple devices in which case, the system 100 may includemultiple attachment structures 110 to house their respective components.The attachment structure 110 can be made of any suitable material andmay include a variety of structural geometries. The attachment structure110 is preferably a wearable or attachable element that may beconfigured for coupling to the body at the torso/chest, the wrist, thearm, the neck, the ear, the head, or at any suitable location. Theattachment structure can be one of a chest band, a wristband,undergarment (e.g., a bra), head mounted device, ring, necklace, or anysuitable wearable item. The attachment structure 110 can include anadhesive attachment mechanism to stick to a user's body (e.g., anadhesive patch). The attachment structure 110 may alternatively includea clasp so as to be attached or released from the body. For example, astrap may include a variable length clasp so that it can be placedaround a user's torso or removed. The attachment structure 110 mayalternatively or additionally include an attachment mechanism such as aclip, button, hoop and loop fastener, magnet, or any suitable attachmentmechanism. The attachment mechanism can function to enable the device tobe attached to another element such as a third party band or to anundergarment. The attachment structure 110 can use any suitable approachto make a wearable device.

As described above the system 100 may include multiple devices. In amultiple device variation, each device can include attachment structure110. Herein, a single device variation is described that houses thebiosensor 120 and the haptic feedback system 130, but any suitablenumber of devices with any suitable configuration of biosensors andhaptic feedback elements may be used. In one variation, the worn devicemay attach to another smart garment or object through a connectorinterface in which case the attachment structure 110 may simply be acartridge housing the components and interfacing with the other item.

When worn, the attachment structure preferably physically couples thebiosensor 120 and the haptic feedback system 130 to a portion of auser's body. The physical coupling may be promoted in regions of thebiosensor 120 and the haptic feedback system 130—physical contact withthe body may be preferred for operation of some variations of thebiosensor 120 (e.g., an ECG sensor) and/or the haptic feedback system130 (e.g., a vibrational feedback system). Alternatively, the attachmentstructure no can promote close proximity to a user if direct contact isnot needed such as an image-based biosensor 120 or a thermal-basedhaptic feedback system 130.

The attachment structure 110 preferably houses a set of devicecomponents. In one variation, the attachment structure 110 includes acartridge or a body structure that functions as the housing. Theattachment structure 110 can include a housing for the biosensor 120,the haptic feedback system 130, a computing system 140 with anynecessary processing, communication, storage, power or other computingcomponents. In one implementation, the attachment structure 110 of onedevice can include a dry skin electrode system with at least twoelectrodes 122 to establish contact with a user's skin. The hapticfeedback system 130 can be included within a central region of theattachment structure as shown in FIG. 2. The haptic feedback system 130may alternatively include a set of haptic feedback nodes 132. The hapticfeedback nodes 132 can be distributed in a variety of configurationsrelative to the attachment structure 110. In a variation where theattachment structure 110 is a torso band, the haptic feedback nodes 132can be positioned along the length of the attachment structure 110 asshown in FIG. 6.

In one implementation, the attachment structure comprises an elasticband that fastens at a cartridge structure. The cartridge structurehouses the biosensor 120, the haptic feedback system 130, and thecomputing system 140. In one variation, the attachment structureincludes two conductive snaps that include a mechanical couplingmechanism to connect the elastic band and the cartridge structure. Theconductive snaps are additionally conductively coupled to the biosensor.

In one implementation, the attachment structure is part of a bra such asa sports bra. Conductive fabric or other suitable garment basedelectrical components may be used in integrating the biosensors and/orhaptic feedback system 130 into the bra. In one variation, the hapticfeedback nodes 132 can be distributed along the bottom seam of the bra,and a main housing body can be removably coupled at the front centerarea of the bra. In another variation, two passive conductive heart ratesensing pads can be integrated into the bra and a main housing body canbe removably coupled at the front center area of the bra as shown inFIG. 8. A conductive connection is established to the integrated sensingpads of the bra.

In yet another implementation, the system 100 may include at least asecond attachment structure, which can function to enable the biosensor120 and the feedback system 130 (or portions of either) to be indistinct locations of the body. A first attachment structure can be wornat a distinct location on the body from the second attachment structure.The heart rate activity sensor can be integrated with one attachmentstructure and the haptic feedback system 130 can be integrated to theother one. Each of the two devices includes portions of the computingsystem 140 to facilitate their respective roles. The two devicespreferably communicate wirelessly, but a wired connection mayadditionally be used.

The biosensor 120 of a preferred embodiment functions to sense at leastone physiological property of a user. The biosensor 120 can preferablysense the heart activity of a user. The biosensor 120 can be anelectrocardiogram (ECG) sensor, an electroencephalogram (EEG) sensor, anelectromyography (EMG) sensor, a galvanic skin response (GSR) sensor, aphotoplethysmography (PPG) sensor, an infrared spectroscopy (NIRS)sensor, a photoplethysmography (PPG) sensor, and/or a breath sensor. Asdiscussed above, one implementation uses a dry skin electrode systemwith at least two electrodes that can detect heart activity when incontact with the body 122. The sensed heart activity is preferably usedto generate a heart rate signal, which can be used in monitoring heartrate variability (HRV). The heart rate signal can additionally becorrelated to breathing rate, but the breathing rate may alternativelybe measured or deduced through other biosensing approaches. In onevariation, the biosensor 120 is can be an ECG sensor. The magnitude ofthe Rspike can be correlated to the breathing rate of a user. The Rspikepreferably is greater when during an exhaling breath compared to aninhaling breath in part because the sensor positioned on the chest maybe physically closer to the heart. Breath may alternatively be senseddirectly using a breath sensor which may include an optical system,motion sensor (e.g., an inertial measuring unit IMU) or any suitabletype of breath sensor. The biosensor 120 is preferably positioned withinthe attachment structure 110 to promote a preferred alignment andorientation on the body.

The system 100 can include one or more biosensors 120. The set ofbiosensors can be of one or multiple types of biosensors 120. The system100 may additionally be adapted to work in combination with inter-bodybiosensors, biosensors of another person, or an external sensor such asan imaging system and/or any suitable biosignal or physiological datasource. In one variation, a non-biological signal may be used inaddition to or in place of a biosignal. An input signal can beuser-generated, an environmental signal of interest, or any suitableinput signal that is not measured from the input biosensors.

In one variation, the system 100 can additionally include an inertialmeasurement unit (IMU), which may include one or more accelerometers,gyroscopes, magnetometers, and/or other inertial sensing components. TheIMU may be used to acquire activity information for a user. The activityinformation may be used in directing the operating mode of the system100. For example, the IMU may be used to detect when the user isparticipating in strenuous activity, in which case increased heart ratecan be attributed to physical activity and not a change in the mentalstate of the user.

The haptic feedback system 130 of a preferred embodiment functions toprovide detectable and unobtrusive feedback to the user. The hapticfeedback system 130 is preferably activated by the computing system 140based on at least the one biosignal. The haptic feedback system 130 ispreferably a primary feedback mechanism, but visual, auditory, and/orother tactile feedback systems may be used.

The haptic feedback system 130 is preferably a tactile feedback systemthat delivers contact stimulation to at least one point on the body. Thetactile feedback elements can apply their stimulation through movementof the attachment structure 110 or other elements. The tactile feedbackelements may alternatively apply stimulation directly to the bodysurface of the user. Direct tactile contact can use less energy and beless obtrusive than applying tactile feedback through motion of theattachment structure 110. The haptic feedback system 130 can includeactuators such as vibrational elements, protruding elements, tappingelements, and/or any suitable type of tactile feedback element. Thehaptic feedback system 130 can additionally or alternatively includehaptic feedback elements such as a heating element. In oneimplementation, the haptic feedback system 130 includes a single hapticfeedback element. For example the haptic feedback system 130 can includeone vibrational motor. The haptic feedback system 130 more preferablyincludes a set of haptic feedback elements (i.e., haptic feedbacknodes). Herein, vibrational nodes are described as a preferredimplementation, but any suitable alternative or additional feedbackelement may be used.

The haptic feedback system 130 preferably includes a set of hapticfeedback nodes 132, more specifically a set of vibrational nodes. Theset of vibrational nodes can be an array of vibrational elements. Thearray of vibrational nodes preferably has a particular arrangement andorganization. The array of vibrational nodes can be a one-dimensionalarray. The one-dimensional array of vibrational nodes is substantiallyarranged in a linear or sequential arrangement as shown in FIG. 7.Activation of the vibrational row nodes may result in a userexperiencing directional movement back and forth across the row ofvibrational nodes. The array of vibrational nodes can be arranged in atwo-dimensional (2D) array. The 2D array may be distributed over aprolonged length of the attachment structure 110 as shown in FIG. 9. The2D array may alternatively be centralized within a particular region asshown in FIGS. 10 and 11. For example, a circular array of vibrationalnodes can enable radial patterns, movement patterns along differentaxis, and other suitable patterns. There may additionally be multiplediscrete 2D arrays of vibrational nodes.

The array of vibrational nodes can be uniformly spaced (i.e.,substantially equal spacing between nodes), non-uniformly spaced (i.e.,varying spacing between the nodes), continuously spaced (i.e., lacking adistinct break or gap in the array of nodes), discontinuous (e.g., onesub-array of vibrational nodes worn on the wrists and a second sub-arrayof vibrational nodes worn on a second wrist).

Feedback is delivered by activation and deactivation of these nodesindependently or in combination or succession. The computing system 140can set the haptic feedback system 130 into an activation mode thatsequentially activates a subset of haptic feedback nodes 132 in thearray of haptic feedback nodes 132. Users may experience successivetransitions between vibrational nodes in the array as directionalmovement along their skin. In a particular implementation, the hapticfeedback system 130 may leverage the cutaneous rabbit illusion approach,which creates the perception of seamless motion across the skin betweendiscrete vibratory nodes. The array of vibrational nodes are preferablystimulated according to the at least one biosignal. The timing,intensity, location, and other properties of stimulation patterns can beused in generating distinct feedback. For example, the temporalcomponent of the pattern, which may impact the sensation of how theperceivable vibration moves along the device, can be proportional to themagnitude of a biosignal.

In one variation the array of nodes can include feedback of at least twotypes. For example, two types of vibrational nodes may be used in thearray of vibrational nodes. In another example, a tactile feedback nodecan be used in addition to a heat-based feedback node.

The computing system 140 of a preferred embodiment functions to manageoperation of the system 100. The computing system 140 is preferablyhoused within the attachment structure no. The computing system 140 caninclude a processor (e.g., a microprocessor), storage, communicationmodule(s) (e.g., Bluetooth, Wi-Fi, cellular data module, etc.),component drivers (e.g., biosensor driver circuitry and haptic feedbackdriver circuitry), power system, and/or any suitable components tofacilitate operation. The power system could be any suitable type ofbattery or source of power such as a rechargeable and/or removablebattery. The power source element could additionally include arecharging element for recharging the power source. The communicationmodule can be a wireless transmitter that may send and/or receive datawith a plurality of external devices, i.e. smartphones, computers, orother devices. In one variation auditory, visual or tactile feedback forthe user is displayed by an external device, like a mobile phone, tabletor desktop computer. The feedback can be communicated with the wirelesstransmitter

The computing system 140 is used to receive, store, and analyzephysiological data to generate at least one biosignal. The at least onebiosignal preferably includes a heart rate signal. The computing system140 additionally manages the activation of the haptic feedback system130. In one variation, activation of the haptic feedback system 130 isbased in part on the heart rate variability in the heart rate signal.The computing system 140 can analyze vital sign data from the biosensor140 and determines appropriate haptic feedback to provide to users. Thecomputing system 140 also determines appropriate feedback to provide tousers based on comparing stored vital sign parameters with a userscurrent vital sign parameters. The computing system 140 can additionallyset the operational mode and drive the haptic feedback system 130according to the appropriate feedback. The computing system 140 isconfigured to transmit both activating and deactivating signals to thehaptic feedback nodes 132 based on previously determined feedbackcriteria. The computing system 140 can additionally manage power,communication, and other suitable computing operations on the device.

The system 100 preferably includes a variety of operational modes. Theoperational modes can be set or partially determined through user input,environmental conditions, and/or other properties. In oneimplementation, the system 100 includes a user control system on thedevice through which the user can specify different operating modes. Inanother implementation, the selectable modes. The user control systemcan be physical user input elements on the device, but may alternativelybe directives communicating from a secondary computing device such as asmart phone, tablet, or computer. In another implementation, theactivity of the user detected by an IMU can be used to activate andsuspend biofeedback depending on detected activity of the user. Inanother implementation, the selectable modes are controlled at least inpart by electromyographic (EMG) muscle input sensor/s embedded in thestrap.

The system 100 preferably includes a monitoring mode, wherein thebiosignals are monitored. The biosensor 120 collects physiological dataand the computing system 140 processes the data. Preferably, thephysiological data is heart rate data. A heart signal is preferably areal-time analysis of heart rate as a function of time. The heart ratesignal will generally have an oscillating property. The variance of theheart rate signal within a localized sample is the heart rate varianceas shown in FIG. 12A. HRV can be correlated to the mental state of theuser including anxiety and stress levels. The cyclical heart ratevariability additionally maps to the breathing patterns of a user asadditionally shown in FIG. 12A. Active feedback can be delivered insynchronization with the heart signal to guide the breathing of theuser. In one variation, the system 100 can activate a feedback mode whenthe HRV is below a particular threshold. In another variation, machinelearning can be applied to classifying and detecting various patterns inthe heart rate signal and/or other biosignals that correlate withparticular mental states.

In another variation, the monitoring mode can monitor the magnitude ofthe Rspike portion of an ECG signal. As discussed above, the Rspike mayhave greater magnitude during an exhaling breath with the greatestRspike magnitude at the end of an exhale (i.e., when the ECG sensor isclosest to the heart). As shown in FIG. 12B, a breathing rate signal canbe generated from the ECG signal.

In a feedback mode, the haptic feedback system 130 is activated. Thehaptic feedback system 130 can be driven in a variety of patterns. Themagnitude, the duration, the sequence or pattern, transition betweendifferent feedback nodes, combination of types of haptic feedback, andother properties of the haptic feedback system 130 can be used to signaldifferent attributes to the user.

In one variation, the vibratory output of a haptic feedback system 130can be set stronger or weaker depending on the physiological signalbeing measured. For example, the magnitude of vibration can beproportional to the magnitude of the HRV signal. Similarly a feedbackpattern can be used to convey some information.

In a variation with an array of haptic feedback nodes 132, the activatedfeedback nodes can provide alternative ways of communicatinginformation. For example, in a 1D array of vibratory nodes positionedaround a band, the activated feedback node can provide information tothe user. For example, different information may be conveyed to a userdepending on if the active feedback node is located in the front, right,left, back, or any suitable location.

In another variation, the activation sequence of a set of hapticfeedback nodes 132 can simulate motion. The haptic feedback system 130can be driven in a sequence across an array of feedback nodes, whichfunctions to feel like movement of the vibration. The speed of themotion, the simulated displacement (e.g., the set of feedback nodes usedin the activated sequence), the shape or stroke path of sequential nodeactivation, and other properties can be used to signal differentinformation to the user. In a 2D array haptic feedback variation, thevibratory output can initiate at the center and expand from a smallerarea to a larger area of the array depending on the biosignal propertiesas shown in FIG. 13. In another variation, the 2D array haptic feedbacksystem 130 can simulate motion along a vector as shown in FIG. 14. Tothe user, the motion may feel like a swiping motion in differentdirections. The magnitude, direction, and angle of the swipe motion canall be used to convey information.

In one variation, the activation of the haptic feedback system 130 is insynchronization with a biosignal. Preferably, the haptic feedback system130 is synchronized to the declining portion of the HRV periodic signalas shown in FIG. 15, which functions to synchronize the user's focuswith the breath. The haptic feedback system 130 can be activated atsubstantially the local maximum of the heart rate signal and thensustained until the local minimum of the heart rate signal. This windowof the heart rate signal can correlate to the outward/exhaling breath ofa user. A user can be reminded to breathe outward during this window.The activation of the haptic feedback system 130 can additionally offsetthe activation window to the biosignal. This can be used to promotelonger or shorter breaths.

In another variation, the activation of the haptic feedback system 130can activate a particular form, shape, or path to communicate variousforms of information. In one implementation, the duration, magnitude andprofile of a path can be used to convey different information. As shownin the first row of FIG. 16, a bell curve path may lean one direction oranother based on the amount to which a user's heart rate is changing.This path could be activated in a multi-directional haptic feedbacksystem 130 such as the ones shown in FIGS. 10 and 11. The path could besynchronized to actuate on every heart beat, every breath, or at anysuitable time. As also shown, the intensity and duration of a pulse pathcan be mapped to the HRV of a user. For example, the intensity could beincreased and the duration decreased to reflect a higher HRV, and a lowHRV would be longer and less intense pulse as shown in the second row ofFIG. 16. Additionally, multiple forms of biosignal feedback can belayered into a single haptic pattern. As shown in the last row FIG. 16,heart rate and HRV feedback can be layered.

The computing system 140 can additionally be distributed betweenmultiple devices. In one variation, the computing system 140 includes afirst device computing system integrated in the attachment structure 110and a second user interface application operable on a second device andin communication with the first device. The first device computingsystem can facilitate sensing and haptic feedback, which the userinterface application portion provides operability on a personalcomputing device. The user interface application can additionallyfunction to provide additional user interface options. The userinterface application is preferably operable on a personal computingdevice such as a smart phone, a tablet, a wearable computer, a desktopcomputer, and/or any suitable computing device. The user interfaceapplication can provide access to graphical user interface, auditorycues, device haptic feedback, and other forms of user interfaces. Thedevice worn by the user can be in communication with the device of theuser interface application. The user interface application can be usedto show historical data, receive user input, and perform any suitabletask.

In one variation, the user interface application can include anemotional tracking module that is configured to collect emotional stateinformation or other forms of emotional data from the user. Theemotional tracking module is additionally configured to log thatinformation. The system 100 can generate a model between emotional stateand the collected physiological data to automatically predict emotionalstate based on collected physiological data. The model can be used toactivate the haptic feedback system 130 in response to the predictedcurrent emotional state so as to communicate the current predictedemotional state to the user. The emotional state can be communicatedusing a variety of activation options of the haptic feedback system 130.One preferred implementation uses maps the predicted emotional state toan emotional coordinate system. One common emotional coordinate systemis a valence and arousal coordinate system. The haptic feedback systemcan be driven to simulate a vector that corresponds to the predictedemotional state plotted on the emotional coordinate system. Magnitudeand angle can both be communicated in a 2D array feedback system asshown in FIG. 17. Alternatively, the mapping to the emotional coordinatesystem may be reduced to an angular representation so as to becommunicated through a 1D array feedback system as shown in FIG. 18.

2. Method for Communicating Biofeedback to a User

As shown in FIG. 19, a method for augmenting a biosignal through activefeedback of a preferred embodiment can include collecting physiologicaldata of at least one physiological property of a user S110, processingthe physiological data into at least one biosignal S120, monitoring theat least one biosignal for a feedback activation condition S130, anddelivering haptic feedback upon satisfying a feedback activationcondition S140. The method functions to provide real-time unobtrusivefeedback to a user based on physiological properties. The method ispreferably used to promote awareness of a user's physiological state.Many biological signals are not readily detectable by a person.Generally, the method can enable an individual to build real-timeawareness of their state, which can function to promote mindfulness in auser. In some cases, a user may be able to use this awareness to addresstheir mental state through mental exercises, breathing exercises,physical exercises, meditation, or any suitable action. In time, a usermay be able to regulate and control the biosignal to some degree basedon trained mindfulness.

More specifically, the method can be applied to coach a user inpracticing breathing exercises or performing other actions atappropriate times based on the biosignal information. For example, themethod can be used to coach a user to breathe out in synchronizationwith their heart rate variability signal.

The method can additionally have applications to medical treatment. Forexample, a therapist could be outfitted with a device with the hapticfeedback system while a biosensor measures the physiological data on apatient. The therapist could have an awareness of the patient'sphysiological state during a therapy session, which can be applied inhow the patient is treated.

In yet another variation, the method can include tracking of emotionalstate, which can be used in automatic detection of emotional state aftercollection of sufficient data. The haptic feedback can then be used tosignal a detected emotional state to a user.

The method is preferably implemented by a system such as the onedescribed above, but the method may alternatively be implemented by anysuitable system. In one variation, the method may be applied within asmart wearable that includes access to a biosensor and a haptic feedbackmechanism. The smart wearable can additionally include a communicationchannel to a biosensor or a haptic feedback mechanism.

Block S110, which includes collecting physiological data of at least onephysiological property of a user, functions to collect information of atleast one health vital property.

The physiological property is preferably heart rate activity. Heart ratedata can be collected by an ECG sensor, an electroencephalogram (EEG)sensor, an electromyography (EMG) sensor, a galvanic skin response (GSR)sensor, a photoplethysmography (PPG) sensor, an infrared spectroscopy(NIRS) sensor, a photoplethysmography (PPG) sensor, and/or any suitabletype of heart rate detection device. The biosignal may alternatively bebreathing rate collected by breath sensor. The heart activity data ispreferably collected with a sampling resolution sufficient to produce areal-time analysis of heart rate variability. The sampling frequency ofinstantaneous heart activity is preferably at least twice that ofexpected heart rate variability frequency. The physiological data caninclude any additional or alternative health vitals or signals. Thephysiological data is preferably sensed from a senor on the device. Thephysiological can additionally be a composite of sensor data from avariety of sample points on the body. Collecting physiological data caninclude sensing data from a biosensor. Alternatively, collectionphysiological data can include retrieving data from a secondary devicesuch as through a communication. For example, a second device, such as asmart watch, may collect heart rate data, and the heart rate data can becommunicated to an application or device of the method.

Block S120 and S130, which include processing the physiological datainto at least one biosignal and monitoring the at least one biosignalfor a feedback activation condition, functions to analyze and monitorthe biosignal for various conditions. Preferably, the biosignal is aheart rate signal. The heart activity data can be processed into a heartrate signal. The heart rate signal preferably corresponds to thebreathing patterns of an individual. Thus processing the physiologicaldata can additionally include generating breathing data. The breathingdata can include breathing rate, instant or average duration of aninhaling breath, instant or average duration of an exhaling breath,average or instant time between breathing, breathing out/in duty cycle,or other suitable properties of breathing.

Collected physiological data is preferably collected and processed intoa biosignal for real-time monitoring. One or more biosignals can bemonitored for satisfying feedback activation conditions. The feedbackactivation condition can be any suitable heuristic or algorithmicallydetermined condition that may trigger some form of haptic feedback. Theheuristic-based condition could be customized by a user throughconfiguration user interface element. The feedback activation conditionmay alternatively be automatically set. For example, a machine learningsystem can be trained in detecting the emotional state of a user basedon previous biosignal and emotion state data.

The condition is preferably the heart rate variance as detected in theheart rate signal falling below a minimum heart rate variabilitythreshold. When the heart rate variability of an individual goes below aminimum threshold, then the user is notified through haptic feedback.The condition could alternatively depend on other factors such as otherbiosignals, geographic location of the user, inputs provided by asecondary device, or any suitable inputs. In one variation, the methodcan include collecting IMU data from the device or a personal computingdevice and classifying the activity level of a user from the IMU. Theactivity level can be used to determine how a biosignal is analyzed. Forexample, if a user is performing strenuous activity, then the heart ratevariability threshold condition can be changed to account for thephysical activity.

Block S140, which includes delivering haptic feedback upon satisfying afeedback activation condition, functions to activate the feedbackmechanism in a meaningful manner. Haptic feedback is preferablydelivered in a variety of different conditions. Haptic feedback can bedelivered when a biosignal is detected to be above or below a particularthreshold. Haptic feedback can additionally be delivered when thepattern of one or more biosignals is detected to have a high correlationto a particular pattern. For example, machine learning could be used tocorrelate biosignals with emotional state (as reported by a user) andthen used in automatic detection of emotional state.

Delivering haptic feedback upon satisfying a feedback activationcondition can include mapping between a value of one or more biosignalsand the activation of a pattern of haptic feedback which functions todeliver haptic feedback in an activation mode corresponding to thecontext of the biosignal. For example, the pattern of feedback may bechanged to indicate different conditions or properties of the condition(e.g., the magnitude of HRV, the type of emotion, etc.). The context maydepend on a classification determined in block S120, the magnitude of ameasurement from block S120 (e.g., the amount over a HRV threshold),and/or any suitable property. In one variation, the haptic feedback isconsistently delivered based on the values of the biosignal.

In one variation, delivering haptic feedback can include synchronizinghaptic feedback to a biosignal, which functions to time the hapticfeedback with the periodic properties of a biosignal. Preferably,activate feedback is synchronized to the hear rate signal as shown inFIG. 15. In this variation, synchronizing haptic feedback to the heartrate signal comprises initiating haptic feedback in coordination with alocal maximum of the heart rate signal and ending haptic feedback incoordination with a local minimum of the heart rate signal, whichfunctions to stimulate the user periods that correlate with an exhalingbreath. Applying haptic feedback in synchronization with a user'sbreathing can increase awareness to achieve a level of mindfulness.

Synchronizing the haptic feedback can additionally include augmentingthe timing of the haptic feedback in coordination with the local maximumand minimum of the signal. In one implementation, this may be done topromote a breathing pattern objective. The method can includedetermining a breathing pattern objective, which may be based on thecurrent physiological conditions, physiological history, or any suitableproperty. Augmenting the timing may include offsetting the initiationbefore or after the local maximum HRV. Similarly, timing may includeoffsetting the ending of haptic feedback to before or after the localminimum. Augmenting the activation window (e.g., the period of hapticfeedback between activation and ending) can encourage differentbreathing patterns. These adjustments can be made to reinforce longerbreaths, shorter breaths, speeding up breathing rate, slowing downbreathing rate, breathing in a particular pattern, or making anysuitable change to breathing. For example, if a user is taking shortbreaths, then the method may augment the timing of synchronized hapticfeedback so that the user is reminded to take longer breaths.

In another variation, delivering haptic feedback can include activatinga sequence of haptic feedback nodes 132 in coordination with thebiosignal. The intensity (i.e., magnitude) and timing of haptic feedbacknode activation can be used to convey different information or todeliver different tactile feelings. In one implementation, an array ofhaptic feedback nodes 132 is activated in a progressive pattern tosimulate motion across the array. The sequence can be a linear pattern,radial pattern, along a vector or path, or in any suitable animatedsequence. The progressive sequence can progress according to an easingfunction (e.g., ease-in, ease-out, bounce, etc.), repeat, changeintensity as a function of time, or augment any suitable property ofsequential activation. The properties of the sequential activation cancorrelate to various properties and can be used to signal differentinformation to the user. In the synchronized haptic feedback variationabove, delivering synchronized haptic feedback can include activatinghaptic feedback nodes 132 of an array in a progressive sequence. In oneexample, the sequence of activation can initiate during the beginning ofan exhale (e.g., at a local maximum HRV) and attenuate until theactivation ends at the end of the exhale window. This activationintensity profile can be adjusted to promote different breathingpatterns. For example, if the user is not breathing out for the fullduration, the intensity may increase to encourage the user to make it tothe end of the desired exhaling window.

Preferably, delivering haptic feedback is delivered to the usercorresponding to the biosignals. However, some variations, may deliverhaptic feedback to at least a second user, which can function to providea physiological form of communication between the first and second user.This may be used during therapy treatment. For example, a therapistcould receive haptic feedback based on the emotional and/orphysiological state of a patient. Similarly, couples or two people coulduse the device during a conversion, which may promote improved empathyor communication.

As discussed above, one embodiment of the method can include retrievingemotional state data over a period of time S150 and predicting theemotional state according to the retrieved emotional state data andcollected physiological data S132. In this variation, haptic feedbackcan be delivered according to detection of emotional state. The feedbackactivation condition is prediction of at least one particular emotionalstate. Processing of the biosignal can include training an algorithmicmodel from the retrieved emotional state data and the biosignal andautomatically predicting emotional state in real-time from thealgorithmic model. Other approaches may alternatively be used such asheuristic based emotional state prediction.

Emotional state data is preferably retrieved through a user interface.The user interface can be personal computing device, a web application,a communication tool, or any suitable interface through which emotionalinformation is collected. A user will preferably periodically log howthey feel. In one variation, the user will log a particular feeling suchas happy, sad, stressed, anxious, angry, and the like. In anothervariation, the user will provide a rating along one or more emotionaldimensions. The user may additionally provide comments or supplyemotional data through any suitable mechanism.

In one variation, a predicted emotional state is mapped an emotionalcoordinate system such as a coordinate system with arousal and valenceas the two orthogonal dimensions. The arousal and valence dimensions canbe used to characterize a variety of emotions. Delivering the hapticfeedback comprises activating at least one of an array of hapticfeedback nodes according to the mapping of the emotional state to theemotional coordinate system S132 as shown in FIG. 20. In a 2D array ofhaptic feedback nodes, an activation sequence simulates the directionand magnitude of a vector corresponding to the position of the emotionin the emotional coordinate system as shown in FIG. 17. For example joycan be classified as high valence (i.e., positive) and high arousal sothe sequence of activating haptic feedback nodes would be a long strokein the first quadrant. Similarly, tense may be slightly negative valenceand medium level of arousal so the sequence of activating hapticfeedback nodes would be a medium length stroke upward and slightly tothe right. In a 1D array of haptic feedback, the haptic feedback may bereduced to the angular position of the predicted emotion in theemotional coordinate system. As shown in FIG. 18, the angle of thevector to the emotion in the emotional coordinate system can berepresented in which node is activated. Joy may be felt in the frontright of the body, relaxation would be in the back right, and stressedwould be on the left front.

The systems and methods of the embodiments can be embodied and/orimplemented at least in part as a machine configured to receive acomputer-readable medium storing computer-readable instructions. Theinstructions can be executed by computer-executable componentsintegrated with the application, applet, host, server, network, website,communication service, communication interface,hardware/firmware/software elements of a user computer or mobile device,wristband, smartphone, or any suitable combination thereof. Othersystems and methods of the embodiment can be embodied and/or implementedat least in part as a machine configured to receive a computer-readablemedium storing computer-readable instructions. The instructions can beexecuted by computer-executable components integrated bycomputer-executable components integrated with apparatuses and networksof the type described above. The computer-readable medium can be storedon any suitable computer readable media such as RAMs, ROMs, flashmemory, EEPROMs, optical devices (CD or DVD), hard drives, floppydrives, or any suitable device. The computer-executable component can bea processor but any suitable dedicated hardware device can(alternatively or additionally) execute the instructions.

As a person skilled in the art will recognize from the previous detaileddescription and from the figures and claims, modifications and changescan be made to the embodiments of the invention without departing fromthe scope of this invention as defined in the following claims.

I claim:
 1. A method for communicating biofeedback to a user through awearable device comprising: collecting physiological data of at leastone physiological property of a user; processing the physiological datainto at least one biosignal, wherein processing the physiological datainto the at least one biosignal comprises processing the physiologicaldata into the at least one biosignal that includes a heart rate signal;monitoring the at least one biosignal for a feedback activationcondition; and upon satisfying the feedback activation condition,delivering a haptic feedback, wherein delivering the haptic feedbackcomprises synchronizing the haptic feedback to the heart rate signal. 2.The method of claim 1, wherein monitoring the at least one biosignal forthe feedback activation condition comprises monitoring the heart ratesignal for heart rate variability below a threshold value.
 3. The methodof claim 2, wherein synchronizing the haptic feedback to the heart ratesignal comprises initiating the haptic feedback in coordination with alocal maximum of the heart rate signal and ending the haptic feedback incoordination with a local minimum of the heart rate signal.
 4. Themethod of claim 3, further comprising determining a breathing patternobjective; wherein initiating the haptic feedback in coordination withthe local maximum comprises augmenting timing of initiation according tothe breathing pattern objective; and wherein ending the haptic feedbackin coordination with a local minimum comprises augmenting timing ofending according to the breathing pattern objective.
 5. The method ofclaim 2, wherein delivering the haptic feedback comprises activating asequence of haptic feedback nodes in synchronization with the heart ratesignal.
 6. The method of claim 5, wherein activating a sequence of thehaptic feedback nodes comprises setting timing and intensity ofactivation according to the properties of the haptic feedback condition.7. The method of claim 1, wherein delivering the haptic feedbackcomprises delivering the haptic feedback according to predictedemotional state based in part on the processed physiological data. 8.The method of claim 7, further comprising retrieving emotional statedata over a period of time, predicting the emotional state according tothe retrieved emotional state data and collected physiological data; andwherein the feedback activation condition is prediction of at least oneparticular emotional state.
 9. The method of claim 8, further comprisingmapping the predicted emotional state to an emotional coordinate system;and wherein delivering the haptic feedback comprises activating at leastone of an array of haptic feedback nodes according to the mapping of theemotional state to the emotional coordinate system.
 10. A system forcommunicating biofeedback to a user through a wearable devicecomprising: at least one attachment structure that houses a subset ofcomponents of the system, wherein the attachment structure can bephysically coupled to the body of the user; a heart activity sensor; ahaptic feedback system; a computing system that generates at least onebiosignal, wherein the at least one biosignal includes a heart ratesignal, and wherein the computing system is operable to manage theactivation of the haptic feedback system based in part on the heart ratevariability in the heart rate signal, wherein activation of the hapticfeedback system is synchronized to the heart rate signal.
 11. The systemof claim 10, wherein the haptic feedback system includes an array ofhaptic feedback nodes.
 12. The system of claim 11, wherein the hapticfeedback nodes of the array of haptic feedback nodes are distributedacross at least two dimensions.
 13. The system of claim 11, wherein thecomputing system can set the haptic feedback system into an activationmode that sequentially activates a subset of haptic feedback nodes inthe array of haptic feedback nodes.
 14. The system of 10, wherein thehaptic feedback system includes at least one type of haptic feedbacknode selected from the set of a vibrational feedback node, a protrudingfeedback node, and a tapping feedback node.
 15. The system of claim 10,wherein the attachment structure can be one of a chest band, awristband, and an undergarment.
 16. The system of claim 10, furthercomprising at least a second attachment structure, wherein the firstattachment structure can be worn at a distinct location on the body fromthe second attachment structure; wherein the heart rate activity sensoris integrated in the first attachment structure to establish conductivecontact with the body of the user when worn; and wherein the hapticfeedback system is integrated in the second attachment structure todeliver direct haptic feedback to the body of the user during activationof the haptic feedback system.
 17. The system of claim 10, wherein thecomputing system includes a first device computing system integrated inthe attachment structure and a second user interface applicationoperable on a second device and in communication with the first device.18. The system of claim 17, wherein the user interface application isconfigured for the collection of emotional data from a user, automaticprediction of current emotion state based on biosignal data and thecollection of emotional data, and communication of an activation signalto the haptic feedback system controlled by the first device computingsystem; wherein communication of the activation signal is in response toa prediction of a current emotion state.